A non-convex optimization framework for large-scale low-rank matrix factorization
نویسندگان
چکیده
Low-rank matrix factorization problems such as non negative (NMF) can be categorized a clustering or dimension reduction technique. The latter denotes techniques designed to find representations of some high dimensional dataset in lower manifold without significant loss information. If representation exists, the features ought contain most relevant dataset. Many linear dimensionality formulated factorization. In this paper, we combine conjugate gradient (CG) method with Barzilai and Borwein (BB) method, propose BB scaling CG for NMF problems. new does not require compute store matrices associated Hessian objective functions. Moreover, adopting suitable step size along proper nonmonotone strategy which comes by convex parameter ηk, results algorithm that significantly improve CPU time, efficiency, number function evaluation. Convergence result is established numerical comparisons methods on both synthetic real-world datasets show proposed efficient comparison existing demonstrate superiority our algorithms.
منابع مشابه
The Non-convex Geometry of Low-rank Matrix Optimization
This work considers the minimization of a general convex function f(X) over the cone of positive semidefinite matrices whose optimal solution X⋆ is of low-rank. Standard first-order convex solvers require performing an eigenvalue decomposition in each iteration, severely limiting their scalability. A natural nonconvex reformulation of the problem factors the variable X into the product of a rec...
متن کاملA Non-convex One-Pass Framework for Generalized Factorization Machines and Rank-One Matrix Sensing
We develop an efficient alternating framework for learning a generalized version of Factorization Machine (gFM) on steaming data with provable guarantees. When the instances are sampled from d dimensional random Gaussian vectors and the target second order coefficient matrix in gFM is of rank k, our algorithm converges linearly, achieves O(ǫ) recovery error after retrieving O(kd log(1/ǫ)) train...
متن کاملA Non-convex One-Pass Framework for Generalized Factorization Machine and Rank-One Matrix Sensing
We develop an efficient alternating framework for learning a generalized version of Factorization Machine (gFM) on steaming data with provable guarantees. When the instances are sampled from d dimensional random Gaussian vectors and the target second order coefficient matrix in gFM is of rank k, our algorithm converges linearly, achieves O( ) recovery error after retrieving O(kd log(1/ )) train...
متن کاملA Nonconvex Optimization Framework for Low Rank Matrix Estimation
We study the estimation of low rank matrices via nonconvex optimization. Compared with convex relaxation, nonconvex optimization exhibits superior empirical performance for large scale instances of low rank matrix estimation. However, the understanding of its theoretical guarantees are limited. In this paper, we define the notion of projected oracle divergence based on which we establish suffic...
متن کاملLarge-Scale Convex Minimization with a Low-Rank Constraint
We address the problem of minimizing a convex function over the space of large matrices with low rank. While this optimization problem is hard in general, we propose an efficient greedy algorithm and derive its formal approximation guarantees. Each iteration of the algorithm involves (approximately) finding the left and right singular vectors corresponding to the largest singular value of a cer...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Machine learning with applications
سال: 2022
ISSN: ['2666-8270']
DOI: https://doi.org/10.1016/j.mlwa.2022.100440